go-algorand 3.19.0-stable Release PR by Algo-devops-service · Pull Request #5793 · algorand/go-algorand

Algo-devops-service · 2023-10-20T17:16:34Z

Overview

In this release we add support for hot and cold data directories for algod, enhance the simulate endpoint by returning app initial states, and speed up starting up private networks by allowing pre-generation of keys. Backend support for future features are also included - stay tuned!

What's New

Hot/Cold data directories: Support for specifying different destinations for data instead of just a single data directory
Pre-generated private network keys: Speed launching new private networks for development by re-using pre-generated keys
Simulate: Return application initial states accessed during simulation
Config: Add MaxBlockHistoryLookback option

Changelog

New Features

Algod: Hot/Cold Data Directories and Resource Paths (#5614)
Docker: Support pregenerated keys in docker private networks (#5735)
Network: add P2PNetwork implementation (#5640)
Simulate: Return application initial states accessed during simulation (#5686)

Enhancements

API: StartFastCatchup initialize parameter (#5752)
AVM: Generate langspec for each version (#5629)
AVM: EC math (#4924)
Build: bump golang.org/x/net from 0.12.0 to 0.17.0 (#5779)
Build: bump github.com/consensys/gnark-crypto from 0.11.2 to 0.12.0 (#5774)
Chore: Refactor catchpoint tracking logic into config (#5725)
Chore: Put the three doc strings about each op together (#5708)
Config: Add MaxBlockHistoryLookback option (#5749)
Devops: update releases page GPG key mentions (#5742)
Docs: Update node config comments so that they can be used for doc generation. (#5729)
Dynamic-lambda: continue tracking the best proposal even after freezing (#5701)
Encoding: eliminate unnecessary allocations (#5655)
Feature: Disable EnableBlockServiceFallbackToArchiver by default. (#5706)
Goal: Add initialize option to 'goal node catchup'. (#5754)
Goal: Add export and import options for genesis files during network creation (#5672)
P2p: Make p2p listen address configurable via config.NetAddress (#5721)
P2p: Return non-loopback multiaddr from Address() if available (#5716)
P2p: peerstore backed phonebook (#5710)
Perf: upgrade go-deadlock (#5760)
Performance: dynamic lambda (#5654)
Simulate: Enable on follower node & allow specifying starting round (#5685)
Teal: Report columns in TEAL source maps (#5776)
Tests: Fix flaky tealdbg unit test (#5768)
Tests: Remove flaky persistent peers test from wsNetwork (#5772)
Tests: Address flakiness with TestMergePrimarySecondaryRelayAddressListsPartialOverlap (#5758)
Tests: update TestCatchupOverGossip to be less parallel and use sub-tests (#5731)
Tools: Block Generator - allow exporting to files (#5714)

Bugfixes

AVM: Cleanly handle broken switch/match programs (#5782)
Catchpoints: check EnableCatchupFromArchiveServers for ledgerFetcher (#5783)
Ci: fix scripts/create_and_deploy_recipe.sh build (#5764)
CICD: Fix RPM repository updating (#5790)
Devops: fix releases page links (#5746)
Docker: Do not disable telemetry if logging.config is present. (#5769)
Docker: Do not catchup if already initialized. (#5756)
Docker: Update docker config with node_exporter path. (#5762)
Revert "ledger: Close the ledger at node shutdown" (#5705)
Scripts(configure_dev): conditional tap homebrew (#5573)
Specs: Change spec generation for Foundation to handle _v*.md (#5751)
Tests: Fix simulate start round flaky test (#5748)
Tools: better heap data rendering (#5761)
Windows: Fix GC (#5745)

Protocol Upgrade

This release does not contain a protocol upgrade.

NOTE
vFuture changes are not yet available in MainNet or TestNet but can be used in private networks.

Additional Resources

Co-authored-by: itennenhouse <ispamjunk@gmail.com>

Co-authored-by: shiqizng <80276844+shiqizng@users.noreply.github.com> Co-authored-by: Ian Suvak <ian.suvak@gmail.com> Co-authored-by: Pavel Zbitskiy <65323360+algorandskiy@users.noreply.github.com>

…lgorand#5685)

Co-authored-by: Nickolai Zeldovich <nickolai@csail.mit.edu> Co-authored-by: cce <51567+cce@users.noreply.github.com>

…and#5712)

Co-authored-by: Zeph Grunschlag <tzaffi@users.noreply.github.com> Co-authored-by: cce <51567+cce@users.noreply.github.com>

…and#5716)

…gorand#5706)

…rand#5721)

…creation (algorand#5672) goal network pregen [-p] [-t]: Generates genesis.json, root and part keys based on the template file [-t]. [-p] (pregendir) is where the genesis files are saved (since this is an inherited required flag), and it must be empty or command will error. goal network create [-r] [-t] [-p]: Imports files from pregendir to networkDir. Importing keys was already possible, but this explicitly copies over the keys from another directory, because network directories are wiped if there is an error during creation.

algorand#5686)

…ests (algorand#5731)

…-remerge

…18.0-remerge

…and#5769)

…lgorand#5774) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: John Jannotti <jannotti@gmail.com>

Co-authored-by: John Jannotti <jannotti@gmail.com>

Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: chris erway <chris.erway@algorand.com>

…ng (algorand#5701) Co-authored-by: cce <51567+cce@users.noreply.github.com> Co-authored-by: Nickolai Zeldovich <nickolai@csail.mit.edu> Co-authored-by: Pavel Zbitskiy <65323360+algorandskiy@users.noreply.github.com> Co-authored-by: John Jannotti <jannotti@gmail.com> Co-authored-by: Jason Paulos <jasonpaulos@users.noreply.github.com>

…lgorand#5783)

codecov · 2023-10-20T17:40:18Z

Codecov Report

Merging #5793 (bcdc8e7) into rel/stable (4ed7ec0) will decrease coverage by 0.37%.
The diff coverage is 60.93%.

@@              Coverage Diff               @@
##           rel/stable    #5793      +/-   ##
==============================================
- Coverage       55.90%   55.54%   -0.37%     
==============================================
  Files             470      473       +3     
  Lines           65138    66815    +1677     
==============================================
+ Hits            36416    37110     +694     
- Misses          26318    27188     +870     
- Partials         2404     2517     +113

Files	Coverage Δ
agreement/demux.go	`91.32% <100.00%> (+0.12%)`	⬆️
agreement/eventtype_string.go	`50.00% <ø> (ø)`
agreement/persistence.go	`78.67% <100.00%> (+1.06%)`	⬆️
agreement/proposalStore.go	`100.00% <100.00%> (ø)`
agreement/proposalTracker.go	`95.55% <100.00%> (+1.11%)`	⬆️
agreement/proposalTrackerContract.go	`42.46% <100.00%> (ø)`
agreement/service.go	`86.60% <100.00%> (+0.49%)`	⬆️
agreement/vote.go	`83.33% <ø> (ø)`
cmd/tealdbg/local.go	`73.88% <100.00%> (-0.32%)`	⬇️
config/config.go	`50.60% <ø> (ø)`
... and 78 more

... and 28 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

algorandskiy

Commits list looks OK to me.
Maybe to move config: Add MaxBlockHistoryLookback option to release highlights?

jannotti and others added 30 commits August 23, 2023 11:22

AVM: EC math (algorand#4924)

828c1df

Co-authored-by: itennenhouse <ispamjunk@gmail.com>

ledger: kv keys allocation optimizations (algorand#5677)

51f5314

Revert "Ledger: Close the ledger at node shutdown" (algorand#5705)

9af066b

Chore: Put the three doc strings about each op together (algorand#5708)

572d728

AVM: Generate langspec for each version (algorand#5629)

ca420de

algod: Hot/Cold Data Directories and Resource Paths (algorand#5614)

9ab1cc3

encoding: eliminate unnecessary allocations (algorand#5655)

10f2f55

Simulate: Enable on follower node & allow specifying starting round (a…

2670e94

…lgorand#5685)

performance: dynamic lambda (algorand#5654)

b0cf5c8

Co-authored-by: Nickolai Zeldovich <nickolai@csail.mit.edu> Co-authored-by: cce <51567+cce@users.noreply.github.com>

p2p: Close all connections and wsPeers on P2P network shutdown (algor…

f12005b

…and#5712)

p2p: peerstore backed phonebook (algorand#5710)

0e67a0b

Co-authored-by: Zeph Grunschlag <tzaffi@users.noreply.github.com> Co-authored-by: cce <51567+cce@users.noreply.github.com>

docker: fix typo in README.md (algorand#5707)

55f6430

scripts(configure_dev): conditional tap homebrew (algorand#5573)

ade30a8

p2p: Return non-loopback multiaddr from Address() if available (algor…

3c77a7f

…and#5716)

Feature: Disable EnableBlockServiceFallbackToArchiver by default. (al…

b212f94

…gorand#5706)

merklearray: simplify single-leaf proofs (algorand#5703)

ba92ba3

p2p: Make p2p listen address configurable via config.NetAddress (algo…

caf472a

…rand#5721)

chore: fix misspelled filename (algorand#5717)

4780a87

Simulate: Return application initial states accessed during simulation (

02b99bb

algorand#5686)

tests: update TestCatchupOverGossip to be less parallel and use sub-t…

2082b1d

…ests (algorand#5731)

Merge remote-tracking branch 'origin/rel/stable' into relstable3.18.0…

0597d91

…-remerge

Bump Version, Remove buildnumber.dat and genesistimestamp.dat files.

f6b9364

Merge pull request algorand#5733 from Algo-devops-service/relstable3.…

527d2c5

…18.0-remerge

p2p: remove TestP2PThreeNodesEvenDist (algorand#5736)

ecb9afb

tests: fix a rare data race in staling tracker tests (algorand#5737)

f965427

tests: fix flaky simulate test (algorand#5738)

beec227

chore: Refactor catchpoint tracking logic into config (algorand#5725)

43fb473

DevOps: update releases page GPG key mentions (algorand#5742)

ea20873

algorandskiy and others added 22 commits September 27, 2023 16:40

tools: better heap data rendering (algorand#5761)

91604df

config: Add MaxBlockHistoryLookback option (algorand#5749)

4945ec0

docker: Update docker config with node_exporter path (algorand#5762)

157f59f

docker: Do not catchup if already initialized. (algorand#5756)

67275a6

ci: fix scripts/create_and_deploy_recipe.sh build (algorand#5764)

79fb8fe

Merge branch 'rel/stable' into relstable3.18.1-remerge

a65f7f4

Prep for remerge

802955b

Fix prep for remerge

9487d3b

Merge pull request algorand#5770 from algorand/relstable3.18.1-remerge

d479850

tests: Remove flaky persistent peers test from wsNetwork (algorand#5772)

a23449d

Merge pull request algorand#5775 from algorand/relbeta3.18.1

6fa0c95

tests: Fix flaky tealdbg unit test (algorand#5768)

4a381cb

docker: Do not disable telemetry if logging.config is present. (algor…

690b07e

…and#5769)

TEAL: Report columns in TEAL source maps (algorand#5776)

92ba7ee

Co-authored-by: John Jannotti <jannotti@gmail.com>

AVM: Cleanly handle broken switch/match programs (algorand#5782)

0358d1d

catchpoints: check EnableCatchupFromArchiveServers for ledgerFetcher (a…

d3df476

…lgorand#5783)

Merge branch 'master' into relbeta3.19.0

4dcc19f

Update the Version, BuildNumber, genesistimestamp.data

b7c9222

Merge pull request algorand#5784 from Algo-devops-service/relbeta3.19.0

27d967d

CICD: Fix RPM repository updating (algorand#5790)

bcdc8e7

onetechnical self-assigned this Oct 20, 2023

algorandskiy approved these changes Oct 20, 2023

View reviewed changes

winder approved these changes Oct 20, 2023

View reviewed changes

gmalouf approved these changes Oct 20, 2023

View reviewed changes

algojohnlee merged commit 7037cb3 into algorand:rel/stable Oct 20, 2023

onetechnical deleted the relstable3.19.0 branch October 20, 2023 20:17

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

go-algorand 3.19.0-stable Release PR#5793

go-algorand 3.19.0-stable Release PR#5793
algojohnlee merged 66 commits intoalgorand:rel/stablefrom
Algo-devops-service:relstable3.19.0

Algo-devops-service commented Oct 20, 2023 •

edited by onetechnical

Loading

Uh oh!

codecov Bot commented Oct 20, 2023 •

edited

Loading

Uh oh!

algorandskiy left a comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

Conversation

Algo-devops-service commented Oct 20, 2023 • edited by onetechnical Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Overview

What's New

Changelog

New Features

Enhancements

Bugfixes

Protocol Upgrade

Additional Resources

Uh oh!

codecov Bot commented Oct 20, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

algorandskiy left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

Algo-devops-service commented Oct 20, 2023 •

edited by onetechnical

Loading

codecov Bot commented Oct 20, 2023 •

edited

Loading